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^  A  class  of  sequential  designs  for  estimating  the  percentiles  of  a  quantal 
response  curve  is  proposed.  Its  updating  rule  is  based  on  an  efficient 

J 

summary  of  all  the  data  available  via  a  parametric  model.  The  "logit-MLE* 
version  of  the  proposed  designs  can  be  viewed  as  a  natural  analogue  of  the 
Robbins-Monro  procedure  in  the  case  of  binary  data.  It  is  shown  to  be  asymp¬ 
totically  consistent,  distribution-free  and  optimal  via  its  connection  with 
the  latter  procedure.  For  certain  choices  of  initial  designs  the  proposed 
method  performs  very  well  in  a  simulation  study  for  sample  sizes  up  to  35.  A 
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nonpararaetric  sequential  design,  via  the  Spearman- kxrber  estimator,  for 
estimating  the  median  is  also  proposed. 
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SIGNIFICANCE  AND  EXPLANATION 


In  many  physical  or  biological  experiments  with  binary  response  a  quanta 1 


response  curve  is  assumed  to  relate  the  probability  of  response  to  the 


corresponding  level  of  the  stimulus  variable.  To  estimate  the  percentiles  of 


the  quantal  response  curve  efficiently,  a  sequential  design  is  often  used  in 


practice.  We  propose  a  new  class  of  sequential  designs  with  updating  rules 


based  on  an  efficient  summary  of  all  data  available  via  a  parametric  model. 


This  method  is  shown  to  be  asymptotically  as  good  as  the  optimal  stochastic 


approximation  method.  More  importantly,  its  finite  sample  performance  in  a 


simulation  study  is  often  better  than  the  latter  method.  For  fixed  initial 


designs,  the  percentage  of  runs  saved  by  using  our  method  ranges  from  25%  to 
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EFFICIENT  SEQUENTIAL  DESIGNS  WITH  BINARY  DATA 
C.  F.  Jeff  Wu* 

1.  Introduction 

A  sensitivity  experiment  is  characterized  by  a  response  curve  that 
relates  the  stimulus  level  applied  to  an  experimental  subject  to  the 
probability  of  response.  The  outcome  of  the  experiment  is  assumed 
dichotomous,  response  or  nonresponse.  This  situation  arises  in  many  fields  of 
research.  In  testing  the  strength  of  materials,  the  stimulus  level  may  be  the 
level  of  impact  energy  applied  to  a  piece  of  material,  and  the  response  is 
either  "fail”  or  "not  fail"  (Wetherill,  1963).  In  testing  explosives,  the 
stimulus  level  may  be  the  height  from  which  a  weight  is  dropped  or  the 
pressure  directly  applied  to  the  explosive,  and  the  response  is  "explode"  or 
"not  explode"  (Dixon  and  Mood,  1948).  In  biological  assays  a  test  animal 
survives  or  not  at  a  given  dose  level  (Finney,  1978).  In  psycho-physical 
research  the  probability  of  detecting  a  stimulus  is  related  to  its  intensity 
level  (Rose  et  al.,  1970).  In  educational  testing,  one  may  want  to  study  the 
"item  characteristic  curve"  that  relates  the  difficulty  level  of  the  test  item 
to  the  probability  of  "right"  or  "wrong"  answer  (Lord,  1971). 

Our  main  interest  is  in  estimating  the  percentiles  of  the  response  curve 
F(x),  which  is  the  probability  of  response  for  a  given  stimulus  level  x. 

The  lOOp  percentile  Lp  is  defined  as 

(1)  F(Lp)  -  p  . 
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For  simplicity  we  assume  F  is  monotone  increasing  and  continuous.  The 
median  of  F,  LQ  g,  is  the  most  commonly  used  measure  of  a  characteristic  of 
the  response  curve.  Xn  some  situations  estimating  Lq.5  is  of  intrinsic 
interest,  but  more  often  it  is  because  Lq.5  is  easy  to  estimate.  In  quality 
assurance  it  may  be  more  relevant  to  study  the  extreme  percentiles,  e.g.,  to 
find  the  impact  energy  level  that  results  in  the  failure  of  material  for  at 
most  10%  of  the  time.  On  the  other  hand  may  be  more  relevant  in 

explosive  research. 

In  this  paper  we  will  present  some  new  sequential  designs  for  the 
efficient  estimation  of  for  small  or  moderate  sized  experiments.  The 

sequential  designs  are  constructed  in  such  a  way  that  all  the  information  in 
the  previous  runs  can  be  efficiently  utilized  in  suggesting  how  the  next  run 
should  be  conducted.  When  the  experimental  runs  are  very  expensive,  the 
saving  of  a  few  runs  by  an  efficient  design  outweighs  the  extra  pains  taken  in 
designing  a  sequential  experiment.  The  sequential  nature  of  the  design 
requires  quick  responses  so  that  the  experiment  will  not  be  unduly  prolonged. 
It  is  suitable,  for  example,  when  the  experimental  facility  is  limited  so  that 
the  experiments  must  be  performed  one  after  another.  It  is  not  applicable  to 
many  biological  experiments  that  involve  inexpensive  animals  and  slow 
responses.  Therefore  our  method  is  more  appropriate  for  expensive  experiments 
with  short  response  time,  which  are  more  often  encountered  in  engineering 
research.  In  educational  or  psychological  testings,  if  a  test  has  to  be 
repeated  routinely  on  many  subjects,  it  pays  off  to  automate  the  design  and  to 
look  for  the  most  efficient  ones  (in  terras  of  reducing  the  number  of  test 
items) . 

In  the  next  section  we  shall  review  two  nonparametric  sequential  designs 
(the  Robbins-Monro  and  the  Up-and-Down  methods)  with  special  reference  to 
small  sample  binary  experiments.  Our  approach  is  to  assume  a  parametric  model 
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for  the  response  curve  and  estimate  efficiently  the  relevant  parameters  in  the 
model  based  on  all  the  data  available*  An  estimated  quantal  response  curve 
(EQRC)  is  constructed  through  the  current  estimate  of  the  parameters  and  the 
next  design  point  is  determined  from  the  EQRC.  If  the  two-parameter  logistic 
model  is  used  and  the  parameters  are  estimated  by  the  maximum  likelihood,  we 
call  it  a  "logit-MLE"  design.  It  is  demonstrated  heuristically  to  be  a 
natural  analogue  in  the  case  of  binary  data,  of  the  Robbins-Monro  (RM) 
procedure  for  continuous  data.  Its  consistency  is  proved  under  two  sets  of 
restrictive  conditions.  Assuming  consistency,  it  is  shown  to  be  asymptotic¬ 
ally  equivalent  to  an  adaptive  Robbins-Monro  procedure.  Therefore  it  is 
asymptotically  distribution-free  and  optimal  (in  a  sense  defined  in  Section 
2),  two  properties  enjoyed  by  the  latter  procedure.  Truncated  versions,  (10) 
and  (21),  of  the  two  methods  are  considered  for  the  purpose  of  stabilizing 
their  performance.  They  are  compared  with  the  nonadaptive  RM  procedure  in  a 
simulation  study  for  sample  sizes  up  to  35.  If  a  fixed  initial  design  with 
wide-spread  design  levels  is  chosen,  the  logitHMLE  design  seems  to  take  full 
advantage  of  the  information  in  the  past  data.  It  substantially  outperforms 
the  adaptive  RM  procedure,  which  in  turn  outperforms  the  nonadaptive  RM 
procedure.  On  the  other  hand,  if  a  (nonadaptive)  RM  procedure  is  used  in 
generating  the  initial  design  levels,  the  relative  performance  of  the  non¬ 
adaptive  RM  design  and  the  two  adaptive  designs  (RM  and  logit-MLE)  depends  on 
the  starting  value  x^  and  the  constant  c  (formula  (2))  in  the  RM  pro¬ 
cedure.  For  good  choices  of  x^  and  c  (specified  in  Section  7),  which 
usually  requires  some  prior  knowledge  about  the  unknown  response  curve,  the 
nonadaptive  FM  design  performs  very  well.  In  the  absence  of  such  knowledge, 
the  two  adaptive  designs  perform  better.  Detailed  comparisons  and  further 


remarks  are  found  in  Sections  6  and  7.  A  nonpararaetric  sequential  design  for 


estimating  the  median  Lg^  is  proposed  via  the  Speaman-Karber  estimator 
Its  limitations  are  discussed. 

2.  Review  and  criticism  of  the  Stochastic  Approximation  method  and  the 
Up-and-Down  method. 

the  Stochastic  Approximation  method  and  the  Up-and-Down  method  are  two 
most  commonly  used  nonparametric  sequential  designs  for  quantal  response 
problems . 

Stochastic  Approximation  Method  (Robbins  and  Monro,  1951): 

Let  yn  *  1  or  0  as  the  nth  experiment  results  in  a  response  or  non¬ 
response.  For  estimating  Lp ,  the  stimulus  level  xn+ 1  of  the  (n+1)th  run 
is  chosen  according  to 

<2)  *n+1  "  xn  “  f  ^n-P>  * 

According  to  the  results  of  Chung  (1954),  Hodges  and  Lehmann  (1955)  and  Sacks 

(1958),  it  is  optimal  to  choose  c  in  (2)  to  be  equal  to  (F'(Lp))-1  in  the 

sense  of  minimizing  the  asymptotic  variance  of  /nix  -L  )  within  the  class 

n  p 

(2).  Except  for  normal  errors,  the  resulting  procedure  is  not  asymptotically 
fully  efficient,  that  is,  its  asymptotic  variance  does  not  achieve  the  Cramer- 
Rao  lower  bound.  Abdelhamid  (1973)  and  Anbar  (1973)  proposed  to  transform 
yn  -  p  in  order  that  the  asymptotic  variance  of  /^(x^-p)  be  minimized. 
However  the  optimal  transformation  depends  on  the  distribution  of  the  errors, 
which  is  typically  unavailable  to  the  experimenter  in  the  situations  under 
consideration.  For  the  rest  of  the  paper,  any  procedure  that  achieves  minimal 
asymptotic  variance  within  the  class  (2)  will  be  called  asymptotically  optimal 
without  special  reference  to  ( 2 ) . 

The  small  sample  behavior  of  (2)  depends  very  much  on  a  good  starting 
value  Xj  (Wether ill,  1963).  Ideally  x ^  should  be  close  to  Lp.  A  good 


guess  of  the  optimal  constant  c  may  also  be  hard  to  come  by  since  in  most 


practical  situations  the  experimenters  have  little  idea  about  the  slope  of 


F  at  L  .  Poor  choice  of  c  and  x.  will  make  (2)  an  inefficient  procedure 
P  1 

for  small  and  even  moderate  samples.  The  stochastic  approximation  method  has 
been  used  more  effectively  in  on-line  estimation  wherein  a  large  number  of 
data  have  to  be  processed  quickly. 

To  achieve  minimal  asymptotic  variance  within  the  class  (2),  it  is 
necessary  to  estimate  the  slope  F'(Lp).  One  such  estimator  is  the  regression 
slope  of  yA  over  x^ , 


1 WV  -  i? 

n  '  Xn  "  n  ^  Xi  ' 

l  <Vxn) 


which  gives  the  following  adaptive  Robb in a -Monro  procedure 

1 


(2a) 


n+1 


- - —  (y  -  p) 

n  nB  " 
n 


Under  various  regularity  conditions,  Anbar  (1978)  and  Lai  and  Robbins  (1981) 

A 

proved  that  6  converges  to  F* (Lp)  and  the  procedure  (2a)  has  the  same 
asymptotic  distribution  as  the  optimal  nonadaptive  Itobbins-Monro  (RM) 
procedure  (2)  with  c  -  (F'  (Lp)  J**1. 

The  FM  procedure  can  be  given  a  finite  sample  justification  if  y  and 
x  are  related  via  a  simple  linear  regression  model 

-  a  +  8xi  +  eA 

2 

where  e^  are  i.i.d.  normally  distributed  with  mean  zero  and  variance  a  . 
Assume  8  is  known  and  the  parameter  of  interest  is  6s  -a/B,  the  solution 
of  the  linear  equation  a  +  0x.  Then  it  can  be  shown  that  (Lai  and  Robbins, 
1979,  Lemma  1)  the  FM  procedure 

<3>  *n+1  "  xn  -  5  yn  '  c  "  0-1 


is  equivalent  to  the  procedure 
(3)* 


—  -1  —  * 
x  .  -  x  -  6  y  ■  -aVB  , 

n+1  n  n  n 


where  a  «  y  -  Bx  is  the  maximum  likelihood  estimate  (MLE)  of  a.  There- 
n  n  n  -  . . .  ■ 1  - - 
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fore  the  next  design  point  xn+ 1  according  to  ( 3 ) '  is  the  solution  of  the 
estimated  linear  equation 

A  A  A 

F  (x)  =  a  +  8x,  a  =  MLE  of  a 
n  n  n 

Although  this  justification  is  specific  to  the  linearity  of  Ey  in  x  and 
the  normality  of  error  e^,  the  consistency  and  asymptotic  normality  of  the 
non-adaptive  PH  procedure  (3)  hold  under  much  maker  conditions.  The 

A 

equivalence  of  (3)  and  (3)'  breaks  down  when  6  is  replaced  by  8  .  Since 

n 

A 

8  is  close  to  6  for  large  n,  it  may  not  be  unreasonable  to  interpret  the 
n 

adaptive  PM  procedure  (2a)  with  p  *  0  as  an  approximation  to  the  solution  of 
the  estimated  linear  equation 

A  A  A  A 

a  +  6  x,  (a  ,8  )  =*  MLE  of  (a, 8) 
n  n  n  n 

for  the  simple  linear  regression  model  and  large  n.  For  the  problem  of 
estimating  Lp  *  F-*(p),  it  can  be  viewed  as  a  stochastic  version  of  the 
Newton-Raphson  method  for  solving  F(x)  *  p  by  the  tangential  approximation 

A 

to  F  at  x  with  F(x  )  replaced  by  y  and  F’(x  )  by  8  •  The 
n  n  n  n  n 

procedure  (2a)  is  aptly  called  a  "stochastic  Newton-Raphson"  method  in  Anbar 
(1978). 

When  n  is  small  or  the  current  guess  xn  is  on  the  tails  of  the 
A-1 

response  curve,  8^  may  behave  erratically.  Since  the  tails  of  the  response 
*  n 

curve  are  flat,  8  with  {x  }  located  on  either  tail  tends  to  be  closer  to 
n 

zero,  thus  making  the  adjustment  from  Xjj  to  xR+  y  in  (2a)  unreasonably 

large.  (It  reminds  us  of  the  well-known  numerical  instability  of  the  Newton- 

Raphson  method  for  solving  the  quantal  response  equation  F(x)  =  p  when  the 

starting  value  x^  is  on  the  tails  of  F.)  This  happens  when  the  initial 

guess  is  poor  for  estimating  the  median  or  when  the  initial  design  takes  too 

few  points  on  the  middle  part  of  the  response  curve  for  estimating  the  extreme 

*-1 

percentiles.  To  remedy  this,  we  propose  to  truncate  8n  ,  that  is,  to  use 

max (min (8  ,d),6)  instead  of  8  for  some  positive  constants  d  >  6.  The 

n  n 


simulation  study  of  Section  6  shows  that  there  is  considerable  improvement  in 
using  this  truncated  version  of  (2a). 


>-and-Down  method  (Dixon  and  Mood,  1948): 


x  +  A 
n 


x  -  A 
n 


if  y 


The  method  works  only  for  Lq^.  very  simple  to  implement  but,  for 

small  or  moderate  samples,  its  performance  depends  very  much  on  a  good  guess 
of  x.|  and  A.  unless  the  step  size  A  is  made  adaptive,  the  large  sample 
property  of  xR  cannot  be  studied.  Its  empirical  performance  is  usually  not 
as  good  as  the  Stochastic  Approximation  method.  This  and  several  modifica¬ 
tions  of  the  two  methods  can  be  found  in  Wetherill  (1963,  1966). 

Both  methods  are  "Markovian”  in  that  the  choice  of  the  next  run  depends 
sensibly  on  the  outcome  of  the  current  one.  Their  simplicity  was  a  crucial 
factor  when  inexpensive  computing  was  not  accessible.  Their  main  disadvan¬ 
tages  are:  (a)  The  updating  rules  (2)  and  (4)  do  not  make  use  of  all  the  data 
available  in  an  efficient  way,  and  thus  making  the  choice  of  step  size  less 
flexible,  (b)  Their  small  sample  behavior  depends  on  a  good  choice  of  the 
relevant  constants  in  (2)  and  (4),  which  in  turn  depends  on  the  experimenter's 
knowledge  of  the  unknown  response  curve  F.  For  small  or  moderate  sized 
experiments  with  expensive  runs,  inefficiency  and  lack  of  robustness  can  be 
quite  serious.  Large  sample  properties,  which  depend  on  locally  linear 
approximations,  are  not  always  relevant  in  this  context. 


To  overcome  the  shortcomings  (a)  and  (b),  an  alternative  method  is 


proposed  in  the  next  section 
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Zf  H(x|0)  in  (5)  equals  a  +  0x,  0  known,  and  the  continuous 
measurement  y  is  related  to  x  through  a  simple  linear  regression  model 
with  normal  error,  the  procedure  (5)  with  the  maximum  likelihood  estimate  is 
identical  to  the  nonadaptive  PM  procedure  (2)  with  c  *  0  1 .  See  the  dis¬ 
cussion  following  (3)  and  (3)'.  In  this  sense  our  proposal  can  be  viewed  as  a 
natural  analogue  of  the  PM  procedure  for  binary  data.  Since  the  straight  line 
model  Ey  *  a  +  0x  provides  a  finite  sample  justification  for  the  PM  method 
for  continuous  y,  it  would  seem  natural  to  use  the  two-parameter  logit  curve 

(6)  H(x 1 6 )  -  (1  +  e"X(X“°t))'1,  X  >  0,  9  *  (a,X ) 

for  modelling  the  binary  response  y  and  the  stimulus  level  x  in  procedure 
(5).  If  X  in  (6)  is  chosen  to  be  a  known  constant,  the  resulting  procedure 
(5)  is  nonadaptive.  When  a  and  X  are  both  estimated  from  the  data,  (5)  is 
adaptive . 

If  the  experimenter  has  some  knowledge  about  his  problem,  it  Bhould  be 
taken  into  account  in  the  choice  of  the  parametric  model  H(  |9).  Given  this 
model  were  there  a  reliable  prior  on  0,  a  Bayesian  approach  (Freeman,  1970; 
Tsutakawa,  1972;  Owen,  1975;  Leonard,  1982)  for  estimating  0  would  be  appro¬ 
priate.  In  the  absence  of  such  information,  it  seems  appropriate  to  use  a 
simple  model  like  the  logit  or  probit. 

The  main  reason  for  preferring  logit  to  its  competitor,  the  probit  model, 

_  (z-u)2 

1  x 

(7)  G(x|  0)  -  -  J  e  dz,  0  -  (u,o),  o  >  0  , 

/2tt  o 

is  computational  ease.  It  is  well  known  that  the  logit,  the  probit  and  other 
parametric  models  like  the  angular  and  the  linear  curves  agree  very  closely  in 
the  range  0.2  to  0.8  (Cox,  1970,  Table  2.1).  We  do  not  see  any  advantage 
in  using  the  probit  over  the  logit.  It  is  rarely  the  case  that  a  parametric 
quantal  response  model  be  justifiable  on  biological  or  physical  grounds.  The 
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successful  use  in  practice  of  the  parametric  approach  for  quantal  response 
problems  is  mainly  due  to  this  key  fact  that  the  parametric  curves  (after 
adjusting  for  location  and  scale)  agree  very  closely  in  a  wide  range  of  p 
values. 

For  p  outside  [0. 1,0.9)  the  percentiles  for  different  parametric 
models  vary  greatly.  The  choice  between  (5)  and  (2)  (or  (2a))  is  not  clear- 
cut.  The  procedure  (5)  is  more  vulnerable  to  the  misspecification  of  F.  On 
the  other  hand,  the  RM  procedure  (2)  or  (2a)  will  require  a  very  large  sample 
size  to  become  distribution-free.  For  instance,  the  method  makes  on  the 
average  nine  negative  moves  for  each  positive  move  in  the  neighborhood  of 
Lq  g.  Instead  of  "straddling"  LQ  ,.s,  the  sequence  makes  far  too  many  moves 
in  one  direction.  This  may  explain  the  much  poorer  empirical  performance  of 
the  RM  method  (2)  even  for  moderate  percentiles  like  1*0.75  (Wether ill,  1963, 
§6). 

A 

The  next  issue  is  the  choice  of  efficient  estimator  8  in  (5)  (i).  Th 

n 

minimum  logit  chi-square  method  (Berkson,  1955)  is  not  suitable  for  the  kind 
of  data  generated  by  a  sequential  procedure  like  (5),  especially  for  small  or 
moderate  samples.  This  is  because  there  are  few,  and  typically  only  one  or 
two,  observations  at  a  given  x  level  to  make  the  minimum  logit  chi-square 
work.  Unless  we  restrict  the  search  of  design  levels  to  a  small  number  of  x 
levels,  the  situation  will  not  change  much.  The  same  remark  applies  to  the 
mini mum  modified  chi-square  method,  and  to  a  lesser  extent,  to  the  minimum 
chi-square  method.  The  maximum  likelihood  estimate  of  (a, A)  in  (6)  is 
obtained  by  iteratively  solving  the  equations 


n 

n 

A  HOli 

|o,A)  -  l  y.  , 

i*1 

1 

n 

n 

),  XjHtx^ 

!«»*>  -  l  yjxi 

(8) 


where  H(x|a,X)  =  (1  +  e  a^)  \  Hie  MLB  (a,X)  is  a  function  of  the 
sufficient  statistics  (E  y^,  E  y^x^ )  and  is  asymptotically  efficient  given 

the  right  model.  Under  (6), 

L  *  a  -  7  4n(-  -  1 ) 

P  *  P 

*  -  1  1 
L  -  a  -  7  ln(~  -  1)  . 

P  x  P 

For  the  implementation  of  (5),  it  is  important  to  know  when  the  MLB 
exists.  Assume  there  are  at  least  two  distinct  x^'s.  It  is  known 
(Silvapulle,  1981)  that  the  MLB  of  the  "linear"  parameters  (X,Xa)  in  the 
logit  model  (6)  exists  uniquely  if  and  only  if  the  following  "interlocking” 
condition  is  satisfied , 

(9.1)  <4in'  x^x)  n  <W  <*x>  is  non-empty 

or 

<9*2>  xmin  <  *min  “  *max  <  4ax 

or 

(9*3>  *min  <  4in  *  4ax  <  *max 

where  xmax(min)  "  Mx(min)  {xi  s  *  l}'  ’W(min)  "  Bax<min> 

(xi  i  yA  -  0}.  Hie  same  result  holds  for  more  general  distributions  F 

including  the  probit  model  (7).  See  Silvapulle  (1981,  Theorem  (iii)).  It  is 
easy  to  see  that  (9),  once  satisfied,  is  always  satisfied  by  the  addition  of 
more  observations . 

If  the  MLB  is  chosen  for  (5  i ) ,  it  is  critical  not  to  start  the  iteration 
in  (5)  until  the  condition  for  the  existence  and  uniqueness  of  the  MLB  is 
satisfied.  A  premature  start  of  the  procedure  (5)  will  lead  to  inconsistent 
estimate  as  the  following  example  shows.  When  (9.1)  -  (9.3)  are  violated,  the 
two  intervals  xJ|Jax]  an<J  ^xmin'  xmax^  separate  or  share  one  point  in 

comon.  Appoint  in  tx^x,  x+inJ  (or  [xjax,  >£in]  whichever  applies) 
maximises  the  likelihood.  Take  an  observation  at  any  such  point  will  again 


1 1 


violate  (9.1)  -  (9.3).  By  repeating  (5),  a  sequence  of  xn  will  be  obtained 
that  lie  in  the  initial  interval  [x^fly ,  xjj^  n] .  if  the  initial  interval  does 
not  contain  the  true  parameter  t^,  the  estimate  xR  for  any  large  n  will 
never  be  close  to  Lp. 

The  question  of  conducting  the  initial  runs  before  there  is  a  unique  MLE, 
is  very  difficult  unless  some  prior  knowledge  is  available.  It  may  be  done  in 
an  ad  hoc  manner  aided  with  experience,  or  by  the  RM  procedure  (2)  with  a 
reasonable  guess  of  x^  and  a  slightly  larger  c  than  the  experimenter's 
guess.  Wetherill  (1963)  showed  that  the  procedure  (2)  with  larger  c  is  less 
susceptible  to  a  poor  choice  of  x^  especially  for  small  samples  (see  also 
the  discussion  of  Table  IV) . 

The  change  from  Xjj  to  xR+1  via  the  logit-MLE  method  may  be  unduly 
large  when  the  problem  is  "ill-posed."  It  happens  in  the  first  few  runs  after 
the  existence  and  uniqueness  of  the  MLE  is  first  satisfied.  We  propose  a 

truncated  version  as  follows.  Define  dn  as  the  solution  of  *n+i  “ 

dn  “  <*  * 
x  -  — -  (y  -  p),  where  x  -  a  -  X  fn(p  -1)  and  (a  )  is  the 
n  n  n  n*r  inn  n  n 

solution  of  (8).  The  (n+1)th  design  level  is  chosen  to  be 
* 
dn 

(10)  x  -  —  (y  -p),d  ■  max(6,  min(d  ,d)),  d  >  6  >  0 

n  n  n  n  n 

According  to  the  simulation  results,  this  truncation  turns  out  to  be  very 
effective. 

Since  the  logit  (and  any  other  parametric)  assumption  is  vulnerable  on 
the  extreme  tails,  it  may  be  desirable  to  use  an  estimation  method  that  places 
less  weight  on  the  observation  with  more  extreme  x^.  For  data  generated  by 
sequential  procedures  like  (2),  (4)  and  (S),  the  x^'s  in  the  initial  runs 
tend  to  be  more  extreme.  A  simple  way  to  achieve  this  is  to  insert  weight 
w^  ■  w(|xj-xnj)  on  both  sides  of  (8)  and  solve  iteratively  the  weighted 
version  of  the  likelihood  equation  (8),  where  w(z)  is  decreasing  in  *  >  0, 


and  xn  is  considered  to  be  a  good  estimate  of  L^.  If  we  choose  w^  to 
be  0  or  1,  it  is  equivalent  to  performing  the  unweighted  MLE  based  on  a 
subset  of  data  with  moderate  x^'s.  The  general  question  of  robut  estimation 
for  quantal  response  data  was  addressed  in  Miller  and  Halpern  (1980). 

For  small  n  we  advocate  the  use  of  a  simple  model  like  the  logit  for 
procedure  (5)  since  it  is  difficult  to  discriminate  between  two  binary 
response  models  (Chambers  and  Cox,  1967).  For  larger  n,  a  symmetric  logit 
or  probit  model  will  not  be  appropriate  if  the  true  F  is  skewed.  A  three- 
parameter  model  may  be  used  in  (5)  when  the  data  indicate  that  the  additional 
skewness  parameter  is  indeed  significant.  This  will  make  the  procedure  (5) 
less  susceptible  to  the  incorrect  initial  choice  of  the  parametric  model.  A 
skewed  logit  model,  (22),  will  be  considered  in  Section  6. 

An  important  question,  which  is  beyond  the  scope  of  the  paper,  concerns 

A 

the  time  to  terminate  the  experiment  with  adequate  information.  Let  v  be  an 

^  (tl  ) 

estimate  of  the  variance  var(L  )  via  the  assumed  parametric  model,  where 

P 

*  /  n) 

L  is  the  MLB  of  Lp  from  the  first  n  observations.  A  stopping  rule  may 

A 

be  devised  based  on  the  value  of  v. 


4.  A  sequential  design  for  estimating  Ln  •  based  on  the  Spearman- 


Karber  estimator 

If  the  unknown  response  curve  F(x)  “  H(x-a,$)  is  skew-symmetric  about 
a,  i.e.  H(z,<fr)  +  H(-z,$)  =  2H(0,$)  for  any  z,  $,  a  is  both  the  median 
l0.5  and  the  mean  of  F*  The  Spearman-KSrber  estimator  (Finney,  1978, 
p.  394)  is  a  nonparametric  estimator  of  the  (discretized)  mean  of  F, 


“SK 

where 

xj  <  ...  <  Xj,  n. 

A 

J 

i/n . »  n  ■  £.  n , . 

*  '*}  ‘  *J-l'  2  ‘Xi-1  *  Xj' 


efficient  estimator  of  a,  an  alternative  sequential  design  for  estimating 


the  median  Lq  ^  °  is  the  following; 


(11) 


(i)  compute  *  aSK(  (y^x)  ^  » 


(n) 


(ii)  set  x  »  a 

n+1  SK 


The  two  distinct  advantages  of  the  procedure  (11)  are:  1)  computational 
ease,  2)  weak  assumption  on  F,  i.e.,  the  functional  form  of  H  is  not 
assumed  known.  But  the  price  to  pay  for  these  is  quite  dear.  The  conditions 
required  to  ensure  a  proper  performance  of  (11)  are  quite  restrictive.  First, 
F  should  be  skew-symmetric  so  that  its  mean  and  median  are  equal.  Since 

A 

a  is  an  unbiased  estimator  of  the  discretized  mean,  not  the  population 
SK 

mean,  their  difference  becomes  negligible  only  when  the  spacing  {x^}”  is 

A 

reasonably  dense.  A  proper  use  of  <*gK  requires  that  x.,  and  Xj  are 
chosen  such  that  F(x^)  *  0,  F(Xj)  =  1,  which  may  be  hard  to  achieve  in  the 
initial  stage  of  the  type  of  sequential  designs  considered  in  the  paper.  If 
the  experimenter  has  to  pray  for  the  validity  of  these  assumptions,  the 
procedure  (11)  can  not  be  truly  "nonparametric . "  Therefore  it  will  not  be 
included  in  the  empirical  study. 


5.  Some  large  sample  results  concerning  the  loglt-MLE  version  of  the 
design  (S) 

In  this  section  some  theoretical  properties  of  the  "logit-MLE"  version  of 
(5)  are  investigated.  Two  consistency  results  are  established  under  rather 
restrictive  conditions.  Assuming  consistency,  it  will  be  shown  that  the 
"logit-MLE"  version  of  (5)  is  asymptotically  equivalent  to  the  adaptive 
Robbins-Monro  procedure  ( 2a ) .  Since  the  latter  is  nonparametric  and  is  asymp¬ 
totically  optimal  within  the  class  of  methods  in  (2),  the  former  is  optimal  in 
the  same  sense  whether  the  true  F  function  is  logistic  or  not.  For  those 
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who  wonder  why  a  model-based  procedure  turns  out  to  be  asymptotically 


distribution-free/  we  merely  recall  the  fact  that  the  Robbins-Monro  procedure 
can  be  formally  viewed  as  a  special  case  of  (5)  with  F(x)  being  a  linear 
function  in  x,  although  linearity  does  not  play  a  role  in  the  asymptotic 
behavior  of  the  FM  procedure. 

First  we  establish  the  equivalence  of  the  nonadaptive  "logit-MLE"  version 
of  (S)  and  the  nonadaptive  HM  procedure  for  estimating  the  median  Lpj. 
Without  loss  of  generality,  we  assume  the  scale  parameter  X  in  (6)  equals 
1.  According  to  (5),  we  have  to  solve  the  first  equation  of  (8)  for 
choosing  xn  and  xn+1,  i.e.. 


(12.1) 


(12.2) 


n- 1  „  n- 1 

y  - 2 - -  y  y 

i-i  t  '  i  V  i 


n 

l 

i-1 


n  .  n 

L  ~  \  yi  • 


1+e 


i  n+1'  1 


By  subtracting  (12.1)  from  (12.2)  and  after  some  algebras,  we  obtain 


(13) 


n 

l 

i-1 


X  -X.  X  ^  -X 

n  i,«  n+1  n. 

« _ Liza _ l _ 

X  -X.  x  ,  ,-x  X  -X. 

...  n  n+1  n  n  i. 

(1+e  ) (1+e  e  ) 


yn“2  ' 


which  defines  x  ^ 

i  m  I;  e  •  •  iDt  Let 

of  *  -  *n+1  ■  V 


-  xn  implicitly  as  a  function  of  yR  - 
A( w)  denote  the  left  hand  expression  of 
It  is  easily  verified  that 


0  <  -A‘(w) 


X  -x.+w 
n  n  i 

)  — a - <  n 

*•  x  —  x .  +w  2  4 


1  ,  n  i  \ 
( 1+*  ) 


^  and  x±, 

(13)  as  a  function 


Since  A(w)  is  monotone  decreasing,  xn+1  _  x„  <  0  ^or  yn  “  1  and  >  0 

for  y  -  0.  Since  A(0)  -  0,  (13)  can  be  rewritten  as 

**  n 


1 


I  ( -A'  ( w)  )dw  «  y  -  —  for  y 

Jx  .  — x  n  2  n 

n+1  n 


x  -x  1 

}Qn  nA'(w)dw  -  yn  -  “  for  yn  -  0 


which  implies,  using  -A'(w)  <  n/4. 


y  -  4  <  -  7  ( x  -x  )  for  y 
Jn  2  4  n+1  n  n 


- (y  •*  4)  <  t  (x  ,  ,-x  )  for  y 
■'n  2  4  n+1  n  Jn 


We  can  now  express  xn+  j  ”  xn  »  >  Robbins-Monro  recursion 


V  4 

n  ,  1. 

x  .  -  x - (y  -  — ) 

n+1  n  n  n  2 


where  bn  is  implicitly  defined  via  the  equation  A(w)  ■  ±  — .  From  (14), 


bn  >  4.  By  further  bounding  bR  from  above,  and  modifying  the  nonadaptive 


"logit-MLE*  version  of  (5)  as  follows. 


xn+1  '  xn  ‘  t  '*»  '  2>>  Bn  ‘  • 


where  B  is  a  constant  >  4,  it  follows  from  standard  results  (Robbins  and 


Siegmund,  1971)  on  the  consistency  of  the  FM-type  recursion  that  the  modified 


‘logit -MLB*  design  (15)  converges  to  Lq>5  with  probability  1* 


A  similar  modification  of  the  adaptive  "logit-MLE*  design  was  considered 


in  (10).  We  are  not  able  to  give  a  rigorous  proof  of  its  consistency. 


although  the  simulation  results  of  Section  6  suggest  that  it  should  be  so.  We 


can  prove  consistency  under  the  very  restrictive  condition  that  the  MLB 


*  »  *  *  # 

(a  ,A  )  in  (8)  converges  uniformly  to  a  constant  (o  ,A  ),  X  f  0,  and 
n  n 


therefore  x 


*  *-1  -1  * 
o  -  X  ln(p  -1)  converges  uniformly  to  a  constant  x  • 
n  n 


More  precisely  we  will  prove  x  “  ,  that  is,  xn  converges  to  the  true 


parameter  whether  the  true  F  is  logit  or  not.  From  (5  ii),  we  have 


H(x  Ja  ,A  )  ■  p,  where  H  is  the  logit  function  (6),  and  as  n  +  “  we 
n+i  n  n 


*.  *  * 

obtain  H(x  | a  ,A  )  -  p.  On  the  other  hand,  the  first  equation  of  (8)  is 


equivalent  to 
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(16) 


4  n  a  *  «  n 

—  \  H(x  |a  ,X  )  -  -  \  y  , 
n  ^  i  n  n  n^  i 


*  *  * 

whose  left  hand  expression  converges  to  H(x  |a  ,X  )  *  p  from  the  uniform 

A  A 

convergence  of  a  and  X  .  For  the  convergence  of  the  right  hand  expression 
n  n 

of  (16),  note  that  y^  has  a  binomial  distribution  with  parameter  F(x^), 

where  x^  is  measurable  with  respect  to  the  past  i  -  1  observations.  From 

a  strong  law  of  large  numbers  in  Dubins  and  Freedman  (1965), 

n  n 

I  Y./l  F(x  )  ♦  1  a.s. 

II 

-1  ?  *  -i  ?  * 

which  implies  n  Z.  y.  ♦  F(x  )  since  n  \  F(x  )  ♦  F(x  ) .  By  equating  the 

1  1 

limits  of  the  two  sides  of  (16),  we  obtain  p  *■  F(x  ),  or  equivalently,  x  = 


Assuming  the  consistency  of  the  "logit-MLEM  design  sequence  xR,  we  will 
prove  that  it  is  asymptotically  equivalent  to  the  adaptive  FM  procedure 
(2a).  Consider  the  approximation 

(17)  J(t)  -  — ~  *  p  +  (t-j"1(p))J'(j”1(p)),  J_1(p)  -  -*n(-  -  1)  , 

1+e-*  P 

which  is  approximately  valid  for  x^  close  to  Lp.  By  applying  (17)  to  (8) 
we  obtain 


n  .  n 

l  (Xx  -  XL  )  - : -  l  (y.  -  P) 

p  J'(J  ^p)) 

n  2  1  " 
l  (Xx  -  XL  x  )  -  - — -  l  (y  -  p)x 

1  P  1  J'(J  (P)) 


where  the  lOOp  percentile  L  -  a  -  ^  in(—  -  1)  *  a  +  —■  J  \p).  The 

V  A  p  A 

A(n)  a 

estimator  L  ,  (19),  is  obtained  from  XL  and  X  by  solving  (18), 

P  P 


n  „n 

v  2\ 


*(„>  XLd  i  Xl^  (Vi-P)*!  -  l  (Vi-Pl 

L  *  A  *  " 

y  n  n  n  n 

1  *1  -  l  xiJ>  ^-p) 
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mm 


which  is  the  weighted  average  of  x^  with  weight  w^  proportional  to 


\  (Ya'PHXj'X.).  Since  L*n*  is  independent  of  J'(J-1(p)),  J'(J-1(p))  in 
a  J  J  1  P 


j 


the  approximation  (17)  can  be  replaced  by  any  other  constant  without  affecting 
the  subsequent  results  (19)  and  (20). 

Note  that  some  w^  may  be  negative.  The  denominator  of  (19)  is  equal  to 


n  \  x  -  \  ij,  x  ,  which  is  nonzero  unless  (  )>  l)  1  ),  x  = 

_  4  *  _ _ 4  1  a  °  <  1 


V1 


Yi-1 


yi=1 


y^l 


n  ^  \  x^ .  Prom  (19)  and  after  some  algebras,  it  is  easy  to  show  that  the 


>  th 


(n+1)  run,  according  to  the  procedure  (5), 


x  ,  „  =  L 
n+1  p 


.  ;<»>  :<n-D  'y„-p)l  <yy: 


aa 

nI  y. (x  -X  ) 
i  x  n 


(20) 


c  l  (x  -x  )‘ 

-  x  -  (y  -p),  c  -  - i  “— 


n  n  n 


n  n 


l  WV 

where  x^  -  n  \  x^ .  Therefore  the  linear  approximation  (20)  to  our 
procedure  (5)  is  asymptotically  optimal  if  cR  in  (20)  converges  almost 


surely  to  [F' (L  )]  Ito  this  end,  note  that  the  regression  slope  estimate 


0  in  (2a)  converges  to  F'(L_)  a.s.  By  comparing  (20)  and  (2a), 
n  p 

c_  -  B  *  n(x  -  x  )  /V  y. (x. -x  ).  Since  both  procedures  converge  to  I* 
**  nnn  iln  P 


>1 


for  large  n,  x_  *  x  and  c  -  B  +  0  follows  from  the  assumption 
n  n  n  n 


F'(Lp)  >  0.  Therefore  the  asymptotic  optimality  of  (20)  follows  from  similar 


results  of  Anbar  (1978)  and  Lai  and  Robbins  (1981).  (Their  regularity 
conditions  do  not  apply  directly  to  the  quantal  response  problem  but  their 
technique  can  be  modified  to  suit  our  purpose.) 
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The  asymptotic  (first  order)  equivalence  of  the  above  two  adaptive 
procedures  can  be  given  a  more  intuitive  explanation.  In  the  adaptive  RM 
procedure,  the  slope  F'(Lp)  of  F  at  Lp  is  estimated  by  the  ordinary 

A 

regression  slope  estimate  8^.  In  the  adaptive  "logit-*4LE"  procedure,  it  is 
estimated  via  the  MLE  of  the  slope  parameter  X  in  the  logit  model.  When 
are  close  to  L^,  the  above  proof  shows  that  the  two  estimates  (the 
latter  one  being  implicit)  of  F'(Lp)  are  essentially  the  same. 

6.  A  simulation  study 

Under  comparison  are  (i)  the  logit-MLE  version  of  the  sequential  design 
(5)  with  truncation  as  defined  in  (10)  (abbreviated  as  MLE  in  the  Tables), 

(ii)  the  adaptive  Robbins-Monro  (ARM)  design  with  truncation, 

Cn  “-1 

(21)  x  -  x  -  — -  (y  -  p),  c  -  max(6,  min(c,B  )>,  c  >  6  >  0  , 

n't*  i  n  n  n  n  n 

A 

where  8^  is  defined  in  (2a),  and  (iii)  the  Robbins-Monro  (RM)  design  (2). 
The  Up-and-Down  design  (4)  was  also  included  in  the  simulation.  The  results 
are  not  reported  here  since  it  is  consistently  the  worst. 

Note  that  the  use  of  the  logit-MLE  design  requires  the  existence  and 
uniqueness  of  the  MLE,  condition  (9).  To  facilitate  the  comparison  of  the 
three  designs,  we  start  with  a  common  initial  design  and  later  branch  to  the 
three  designs  when  (9)  is  satisfied.  Two  distinct  choices  of  the  initial 
design  are  considered.  The  first  has  fixed  design  levels  and  sample  size. 
Initial  samples  that  do  not  satisfy  (9)  have  to  be  discarded.  The  second  uses 
the  nonadaptive  RM  design  as  the  initial  design  and  branches  to  the  logit-MLE 
and  to  the  ARM  at  possibly  different  times.  The  size  of  the  initial  design  is 
random  but  no  simulation  sample  is  discarded.  The  difference  between  these 
two  choices  of  initial  design  and  their  practical  relevance  will  be  discussed 


later 


Five  models  are  used  in  simulating  the  true  quantal  response  curve,  the 
logit  model  (6),  the  probit  model  (7),  the  skewed  logit  model  (22), 

(22)  H(x | X)  -  (1+e"XX)“2  , 

the  complementary  log-log  model  (23), 

Xx 

(23)  H(x| X)  =  1  -  e"e 

and  the  logit  model  with  a  cubic  term,  (1  +  exp(-x  -  ~  x3)  \  Results  from 
the  last  model  are  not  reported  in  Section  6. 1  since  they  give  essentially  the 
same  conclusion.  For  each  H,  the  binary  response  y  =  0  or  1  is 
generated  according  to  u  >  or  <  H(x),  where  u  is  a  uniform  random  number 
in  [0,1]  and  x  is  the  corresponding  stimulus  level.  The  same  set  of 
random  numbers  u^  is  used  for  all  designs  under  comparison.  Note  that  for 
the  logit-MLE  design,  the  MLE  is  always  computed  on  the  logit  assumption,  no 
matter  what  the  true  distribution  H  is. 

6.1.  Fixed  Initial  designs 

A  fixed  initial  design  x±,  i  »  1(1)10,  is  chosen  and  the  corresponding 

y^  is  generated  according  to  the  true  distribution  H  as  described  above. 

*  *  10 
Let  the  of  in  the  logit  model  based  on  ^j/y^i  • 

The  common  starting  value  for  all  designs  under  comparison  is  chosen  to  be 

*  A-1  -i 

x^  ■  <*10  -  X1Q  fn(p  -  1)  according  to  (5)(ii).  Once  x^  is  chosen,  the 
subsequent  design  levels  x12'*'*'x35  are  9enerated  according  to  different 

A  A 

design  schemes.  If  the  MLE  does  not  exist  the  simulation  sample 

A  A 

is  discarded.  On  the  other  hand,  if  {“io'^IO^  exists  and  is  unique,  the 
subsequent  MLE  always  exists  as  is  obvious  from  condition  (9).  This  is 
repeated  for  500  times,  including  those  discarded  due  to  the  nonexistence  of 
MLE. 
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For  sample  size  n,  the  Monte  Carlo  mean  square  error  (MSB)  of  a 


2 

sequential  design  Is  calculated  as  the  average  of  (xn  -  Lp)  over  the 
simulation  samples.  In  Tables  I  and  II,  /MSB  are  given  for  the  designs  (1)  - 
(111)  for  estimating  1*0,5  and  1*0,75  ^or  a  f«w  Initial  design.  Other 
initial  designs  were  considered  in  Wu  (1983).  The  conclusions  are  very 
similar.  In  each  table  Lp  denotes  the  design  level  that  corresponds  to 
the  lOOp  percentile  of  the  true  response  curve.  Therefore,  for  example,  the 
two  initial  designs  in  Tables  1(a)  and  1(b)  are  identical,  but  correspond  to 
different  percentiles  under  different  response  curves. 

The  results  in  Tables  I  and  II  are  summarized  as  follows. 

(A)  General  comparison  of  designs 

In  general,  MLB  performs  substantially  better  than  ABM  and  m,  with  the 
latter  two  being  quite  comparable.  Only  in  Table  11(b)  does  RM-16  (the 
Robbins-Monro  method  (2)  with  c  -  16)  outperform  the  others.  But  when  the 
size  of  the  initial  design  is  increased  from  10  to  14  as  in  Table  Il(bl), 
MLB  has  again  the  best  performance. 

Within  HM  we  observe  the  descending  order  of  performance 
RM-32  and  RM-16  >  RM-4  >  RM-1  >  RM-0.25. 

Mote  that  RM-4  is  asymptotically  optimal  for  the  distributions  in  Tables 
I(a)(c),  because  F' (1*0,5)  “  1/4.  RM-4  fails  to  deliver  this  asymptotic 
promise  of  optimality  for  n  as  large  as  35.  To  save  space,  RM-1  and  RM- 
0.25  are  not  included  in  the  tables. 


TABLE  1.  Mans  CARLO  «MSE  CF  SEQUENTIAL  DESIGNS  fOR  ESTIMATING  THE  SO 
SBCENTUE  OF  THE  TNJE  QUANIAL  RSPCNSE  CURVE  (BASFT  N  500 


1(a)  Initial  design: 


^2vslev^L  I*#1  1^.3  ^.5  l*.9 


no.  of  dbsexvaticns 


True  response  curve:  logit  model  (6)  with  a  -  0,  X  »  1 


CSWfS 

12 

16 

20 

25 

30 

MLE-30  1.44  1.02  .72  .56  .43 

MLE-50 

1.40 

.78 

.53 

.47 

.40 

MIS-100 

1.40 

.60 

.49 

.46 

.40 

MLE-200 

1.36 

.61 

.54 

.48 

.40 

MLB-600 

1.48 

.78 

.56 

.45 

.41 

MM- 16 

1.55 

1.29 

1.09 

.92 

.78 

AIM-30 

1.52 

1.16 

.88 

.69 

.53 

AIM-50 

1.54 

1.16 

.91 

.69 

.55 

AIM-100 

1.59 

1.24 

.99 

.80 

.62 

AIM-600 

1.63 

2.02 

1.66 

1.67 

1.36 

EM-32 

1.84 

1.41 

1.21 

.94 

.81 

FM-16 

1.58 

1.31 

1.14 

.97 

.83 

IM-4 

1.59 

1.46 

1.37 

1.29 

1.23 

Lp  »  10<fc>  percentile  cf  the  true  response  curve, 

MLB-d  »  procedure  (10)  with  vpper  truncation  bound  d  and  lower  truncation  bound 
JIlM-c  »  procedure  (21/  with  upper  truncation  bound  c  and  lower  truncation  bound 
FM-c  *  prooedure  (2)  with  oonstant  c 

M  »  total  nunfcer  of  simulation  sanples  fcr  vfoidi  no  MIE  exists 


1(b)  Initial  desigi  ( 


•tinilus  level  ^.3  ^.46  *0.56  *0.66  *0.80 

1  (sane  as  1(a)): 

no.  at  cbservaticns  1  2  4  2  1 

curve:  prdbit  model  (7)  with  u  ”  -0.5,  a  ”  3.1915 


MUK 


MUB-50 
MLB- 100 

Ma-200 


AIM- 100 


1(c)  Initial  desicpi: 


8tjBu3us  lavel  *0.1  ^.3.  *1.5  *10.7  h.9 
no*  of  observations  12421 


Boss  response  curve:  skewed  logit  model  (22)  with  X  =  1 


desigi 

12 

16 

n 

20 

25 

MIS-30 

MIS-50 

5.17 

4.93 

3.81 

2.80 

2.90 

1.47 

2.05 

1.00 

MIS-100 

4.3B 

1.16 

.99 

.93 

MIS-200 

3.61 

1.10 

.95 

.92 

MIS-600 

4.03 

1.57 

.90 

.89 

MM- 16 

5.37 

4.64 

4.12 

3.61 

AM-30 

5.28 

4.28 

3.61 

3.02 

AIM-50 

5.29 

4.29 

3.63 

3.02 

AM-100 

5.33 

4.31 

3.65 

3.04 

AM-600 

5.89 

4.82 

4.11 

3.34 

M-32 

5.22 

3.86 

2.91 

2.05 

M-16 

5.35 

4.64 

4.11 

3.59 

M-4 

5.52 

5.32 

5.17 

5.02 

M*  112 

efclaulan  lend 

*0.1  *0.3 

*13.5  *10.7  h.9 

1(d)  Initial  design: 

no.  of  observations 

1  2 

4  2  1 

Tkue  ze 

qponae  curve:  oonplementary  log-log  model  (23)  with  X  ■  1 

MIS-30 

MIS-50 

ms-loo 

ms-200 
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WBIfr  n.  MDNTO  CARD3  *'SsE  OF  SEQUH/TIAL  DESIOiS  FDR  ESITOMUG  TOE  75 

PEHCWrm  OP  TOE  TTOE  QUANTAL  FESDNSE  CURVE  (BASED  CN  500  SAMPLES; 


n(a)  Initial  design  and  true  response  curve:  sane  as  in  1(a) 


design 

12 

16 

20 

25 

30 

MLE-30 

1.43 

.87 

.70 

.61 

.56 

MLE-50 

1.36 

.80 

.64 

.56 

.53 

MLB-100 

1.3B 

.77 

.64 

.58 

.55 

MLE-200 

1.43 

.77 

.65 

.59 

.56 

ML0-6OO 

1.49 

.76 

.65 

.59 

.56 

AIM-16 

1.54 

1.19 

1.02 

.87 

.78 

AIM-30 

1.55 

1.21 

1.05 

.89 

.79 

AIM-50 

1.60 

1.26 

1.09 

.93 

.83 

AIM-100 

1.69 

1.37 

1.19 

1.01 

.90 

AIM-600 

1.71 

1.41 

1.73 

1.39 

1.16 

JM-32 

1.69 

1.23 

1.16 

.93 

.87 

FM-16 

1.51 

1.13 

.93 

.75 

.68 

m-4 

1.57 

1.41 

1.2B 

1.17 

1.08 

Str  explanation  of  syrrtools, 


the  batten  of  Table  1(a) 


H(b)  initial  design  and  true  response  curve: 


in  1(b) 


desigi 

12 

16 

100-30 

1.97 

1.47 

HtB-50 

1.95 

1.51 

*00*100 

2.09 

1.38 

100-200 

2.33 

1.43 

100-600 

2.33 

1.41 

AIM-16 

2.02 

1.80 

AIM-30 

1.98 

1.74 

AIM-50 

1.99 

1.80 

AIM- K)0 

2.07 

2.08 

*  V  v?* 


Btirulua  level* 


n(bl)  initial  desicp: 


*0.3  ^.46  *0.56  *10.66  *0.80 


no*  e t  observations 


initial  ample  size:  14 

ttue  zeaponee  curve:  sane  as  in  11(b) 


n 

design  16  20  25  30  35 


MIS-30 

2.23 

1.63 

1.37 

1.13 

.99 

MLB- 50 

2.23 

1.42 

1.20 

1.06 

.97 

MLB-100 

2.27 

1.31 

1.16 

1.07 

1.01 

MLB-200 

2.76 

1.40 

1.18 

1.11 

1.03 

MIS-600 

2.91 

1.48 

1.17 

1.2S 

1.07 

AIM-30 

2.24 

1.91 

1.60 

1.44 

1.31 

AIM-50 

2.26 

1.97 

1.71 

1.52 

1.38 

AIM-100 

2.31 

2.10 

1.82 

1.62 

1.41 

AIM-600 

2.96 

3.36 

3.12 

2.72 

2.38 

IM-32 

2.15 

1.67 

1.36 

1.20 

1.04 

IM-16 

2.20 

1.77 

1.46 

1.2B 

1.13 

FM-4 

2.31 

2.15 

2.01 

M  -  16 

1.90 

1.81 

i  in  H(b) 

n<o 

initial  desicp  and  true  leapcn 

■e  curve:  sene 

as  in  1(c) 

design 

12 

16 

n 

20 

25 

30 

35 

MLS-30 

3.86 

3.04 

2.63 

2.26 

1.83 

MIS-50 

3.67 

2.59 

2.07 

1.59 

1.25 

1.01 

MIS-100 

3.35 

1.80 

1.02 

.97 

.91 

.91 

MIS-200 

2.98 

1.09 

.96 

.96 

.91 

•89 

MtS-600 

1.87 

1.28 

.98 

1.17 

.91 

.90 

AIM-30 

3.95 

3.22 

2.76 

2.35 

2.10 

1.88 

AIM-50 

3.88 

2.96 

2.36 

1.81 

1.47 

1.20 

AIM-100 

3.75 

2.50 

1.76 

1.41 

1.22 

1.11 

AIM-200 

3.52 

2.24 

1.87 

1.47 

1.29 

1.15 

AIM-600 

3.52 

2.60 

2.53 

1.92 

1.57 

1.33 

IM-32 

3.92 

3.09 

2.66 

2.25 

2.01 

1.79 

IM-16 

4.00 

3.48 

3.18 

2.92 

2.72 

2.57 

IM-4 

4.13 

3.97 

3.85 

3.73 

3.65 

3.58 

M-  112 
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11(d)  initial  dealer  and  true  response  curvet  same  as  in  1(d) 


n 


dMigi 

12 

16 

20 

25 

30 

35 

MLE-30 

4.63 

3.64 

3.18 

2.70 

2.37 

2.11 

MLE-50 

4.48 

3.16 

2.43 

1.79 

1.41 

1. 14 

MLE-100 

4.36 

2.08 

1.21 

.91 

.92 

.87 

MLE-200 

4.67 

1.41 

1.09 

.89 

.90 

.85 

MLfi-600 

4.97 

1.92 

1.00 

.8S 

.93 

.85 

AIM-30 

4.74 

4.03 

3.67 

3.35 

3.11 

2.91 

AIM-50 

4.77 

4.08 

3.70 

3.37 

3. 13 

2.93 

AM-100 

4.89 

4.17 

3.77 

3.43 

3.19 

2.99 

AM-200 

5.16 

4.47 

4.02 

3.66 

3.39 

3.18 

AM-600 

6.54 

5.61 

4.95 

4.45 

4.10 

3.82 

M-32 

4.63 

3.75 

3.25 

2.76 

2.40 

2.14 

IM-16 

4.74 

4.13 

3.81 

3.53 

3.32 

3.14 

M-4 

4.89 

4.69 

4.55 

4.43 

4.33 

4.25 

M  -  69 


(B)  Superiority  of  the  logit -MLE  design. 

The  superiority  of  the  logit -MLE  design  (10)  with  upper  truncation 
bound  d  and  lower  truncation  bound  0,  hereafter  denoted  as  MLE-d ,  is 
broad-based.  In  the  nine  tables,  MLE-50,  MLE-100,  MLE-200  consistently  out¬ 
perform  the  best  ABN.  Except  in  Table  11(c),  MLE-30  outperforms  the  best 
ABM.  The  efficiency  gain  of  MLE  over  ABM  is  more  conspicuous  for  larger  n. 

What  truncation  bound  d  should  be  chosen?  Hie  MLE  designs  with 
50  <  d  <  600  all  perform  well.  Within  this  range  their  difference  of 
performance  is  probably  negligible.  MLE-30  does  not  perform  as  well,  because 
a  forceful  truncation  like  d  ■  30  limits  the  potential  of  the  MLE  design  in 
making  more  flexible  and  justifiably  large  moves. 

Since  a  major  purpose  for  finding  better  designs  is  to  reduce  the  number 
of  runs  required  for  satisfying  an  error  bound,  we  shall  measure  the 
efficiency  gain  of  the  MLE  design  over  the  ABM  design  by  such  numbers.  In 
each  case,  we  find  the  smallest  /MSB  achieved  by  the  best  ABM  design  at 


n  *  35.  We  then  find  m  to  be  the  smallest  sample  size  at  which  an  MLE 
design  achieves  the  same  /MSB.  In  Table  III,  the  values  of  m  are  obtained 
by  linear  interpolation  for  the  nine  tables  in  Tables  I  and  II.  The 
percentage  of  runs  saved  by  using  the  best  MLE  design  instead  of  the  best  ARM 
design  ranges  from  25%  to  57%. 

Table  III.  Values  of  m  for  Tables  I(a)-(d),  II(a)-(d) 

1(a)  1(b)  1(c)  1(d)  11(a)  11(b)  Il(bl)  11(c)  11(d) 

26  t6  15  15  18  25  20  16  15 


C.  ARM  or  RM? 

The  best  FM  design  is  RM-32  or  RM-16  and  is  quite  comparable  to  the  best 
ARM  design.  In  Tables  I(c)(d),  11(a) (b)(b1 ) (d)  it  even  beats  the  best  ARM. 

But  the  performance  of  the  RM  design  depends  critically  on  the  choice  of  the 
constant  c  in  (2),  which  may  not  be  available  in  practical  situations.  On 
the  other  hand,  the  ARM— c  (procedure  (21)  with  upper  truncation  bound  c  and 
lower  truncation  bound  0)  performs  well  and  stably  over  a  broader  range  of 
the  c  values,  16  <  c  <  100  for  l*o«5  *n<*  30  <  c  <  200  for  Hie 

ARM-600  design,  which  uses  a  loose  truncation  bound,  is  consistently  worse 
than  the  best  ARM  design  and  the  best  RM  design.  Moreover  its  MSB  exhibits  an 
erratic  pattern,  e.g.,  it  sometimes  increases  as  n  increases.  Generally  the 
ARM  requires  more  severe  truncation  than  the  MLE.  Hiis  is  because  the  ARM  can 
make  an  unduly  large  move  as  explained  in  Section  2. 

D.  Bor  the  same  truncation  bound,  the  MLE  design  always  requires  more 
truncations  than  the  ARM  Design.  It  suggests  that  the  MLE  design  makes  large 
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moves  more  frequently  than  the  ABM  design.  Since  MLE-100,  MLE-200  and  MLE-600 


do  very  well  in  the  study,  such  large  moves  are  probably  justifiable. 

We  have  also  examined  the  empirical  behavior  of  the  same  set  of  designs 
for  initial  designs  of  size  25.  The  results  are  very  similar.  As  the  size 
of  the  initial  design  increases,  the  number  of  simulation  samples  for  which  no 
MLE  exists  quickly  drops. 

6.2  Nonadaptive  EM  as  the  Initial  designs 

We  choose  two  starting  values  x^  *  Lj  and  Lq  g  and  three  recursive 
schemes  BM-1,  EM-4  and  EM-16  as  the  common  initial  designs.  The  logit  model, 
(6),  the  skewed  logit  model  (22)  and  the  complementary  log-log  model  (23),  all 
with  FMLq^j)  *  1/4,  are  considered.  The  two  initial  designs  EM-1  and  RM-16 
correspond  to  over-  and  under-estimates  of  the  true  slope  F' (lq> 5) .  The 
starting  values  Lg  g  and  Lq  g  represent  good  and  poor  guesses  of  LQ 
Define  the  two  switching  times  as  follows: 


n1  -  first 

n  >  5 

such 

that 

8  ,  (2a)  is  non  zero, 

n 

n2  -  first 

n  >  5 

such 

that 

(9)  is  satisfied. 

For  each  initial  design,  denoted  by  D,  three  sequential  designs  are 
considered: 

I.  design  D  for  1  <  n  <  35 

II.  design  D  for  1  <  n  <  n^,  followed  by  the  adaptive  m,  (21), 

with  truncation  bounds  6  and  c  for  n^+1<n<35  (denoted 
by  ABM(6,c) ) 

III.  design  D  for  1  <  n  <  n^,  followed  by  the  logit-MLE,  (10),  with 

truncation  bounds  £  and  c  for  n2  ♦  1  <  n  <  35  (denoted  by 
MLE(6,c)). 

The  size  of  the  initial  design  n^  or  n2  is  random  and  n^  is  always 
smaller  than  or  equal  to  n2«  The  time  n1  for  switching  to  the  ABM  is  5 
in  most  situations.  The  interquartile  range  for  n2  (time  for  switching  to 
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the  MLE)  is  [6,8]  or  [7,9].  We  have  also  tried  a  delayed  version  of  design 


Zl,  namely,  to  switch  to  the  ARM  at  time  n2  instead  of  n^.  Its  performance 
is  somewhat  inferior  and  is  therefore  abandoned.  As  argued  in  Section  3,  it 
may  not  be  a  good  idea  to  start  the  logit-MLE  recursion  as  soon  as  (9)  is 
satisfied.  To  prevent  the  MLE  estimate  from  being  "trapped"  at  a  point  far 
from  we  consider  a  delayed  version  of  the  above  design  III  with 

lag  %, 

(24)  IV.  design  III  with  n^  replaced  by  n2  +  t  (denoted  by  EMLE  (6,c ,1)) 

We  choose  (6,c)  “  (0.01,600)  and  (1,100)  in  the  simulation  study.  Only 
the  estimation  of  Lg  g  is  considered.  The  Monte  Carlo  mean  square  error  of 
each  design  is  computed  based  on  1000  simulation  samples.  To  save  space, 
the  results  on  the  skewed  logit  model  are  not  given  here  since  they  are  quite 
consistent  with  those  reported  in  Table  IV. 

The  results  in  Table  IV  do  not  exhibit  a  clear-cut  pattern  as  those  in 
Section  6.1.  To  facilitate  the  following  discussion,  we  group  the  six  initial 
designs  into  two  categories  (G  for  good,  P  for  poor): 


(G) 

<L0.6'BM"1)' 

(L0#6,RM-4), 

(Lq.9,RM-4) 

(P) 

(L0>6,RM-16), 

(l0>9,rm-1). 

(L0>9,RM-16) 

Since  the  performance  depends  on  the  initial  design,  we  start  our  comparison 


on  the  nonadaptive  FM  design. 


1 )  For 

X1  “  l0.6' 

RM-1 

>  RM-4  >  RM-16 

for 

X1  “  l0.9' 

RM-4 

>  RM-16  >  RM-1 

where  ">"  denotes  "better  than".  The  choice  of  the  starting  value  x 1 
interacts  with  the  choice  of  the  constant  c  in  RM-c.  Since  FMLq^^)  3 
1/4,  R4-4  is  asymptotically  optimal,  which  confirms  the  result  for  = 
L0(9>  But  when  the  starting  value  Lg>6  is  close  to  the  true  parameter 
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TABLE  IV.  MOW®  CARLO  CF  SEQUENTIAL  DESIGNS  TOR  ESTIMATING  THE  50 

EESCENITIZ  CF  THE  TRUE  QUWEAL  RESPONSE  CURVE  (BASED  CN  1000  SAMPLES) 

IV{a>  live  response  curve:  logit  model  (6)  with  a  *■  0,  X  »  1  (F*  (I^>5)  ■  V4) 


starting  initial 

value  design 

sequential 

design 

10 

12 

16 

n 

20 

25 

30 

35 

X1  "  Lo  6 

m-i 

.46 

.45 

.43 

.41 

.39 

.38 

.36 

1  W*D 

ARK  0.01,600) 

.53 

.52 

.50 

.48 

.63 

.64 

.58 

ARK  1,100) 

.52 

.53 

.53 

.49 

.46 

.44 

.42 

ML£(0.01,600) 

.49 

.52 

.47 

.47 

.47 

.45 

.51 

MLE(  1,100) 

.50 

.48 

.47 

.44 

.43 

.41 

.38 

EMLE(  1,100,3) 

.50 

.59 

.46 

.45 

.41 

.41 

.39 

1H-4 

RH4 

.73 

.65 

.57 

.51 

.44 

.39 

.36 

ARK 0.01, 600) 

.99 

.89 

.77 

.69 

.59 

.52 

.46 

ARK  1,100) 

.99 

.89 

.77 

.68 

.59 

.51 

.46 

MI£(0.01,600) 

.80 

.77 

.72 

.64 

.60 

.59 

.55 

MtE(  1,100) 

.79 

.78 

.70 

.60 

.55 

.52 

.46 

CMLE(  1,100,3) 

.77 

.70 

.62 

.58 

.54 

.49 

.45 

m-16 

R4-16 

1.08 

.98 

.83 

.71 

.64 

.59 

.51 

ARK0.01,600) 

1.11 

.94 

.75 

.62 

.54 

.50 

.43 

ARK  1,100) 

1.11 

.94 

.75 

.62 

.54 

.50 

.43 

M1E(0. 01,600) 

.77 

.74 

.64 

.61 

.58 

.56 

.54 

MLE( 1,100) 

.77 

.69 

.61 

.56 

.51 

.47 

.44 

002(1,100,3) 

.96 

.79 

.64 

.56 

.51 

.46 

.43 

*  -  L  W-1 

R4-1 

1.29 

1.23 

1.16 

1.10 

1.05 

1.01 

.97 

1  u.y 

ARK0.01,600) 

4.44 

3.93 

3.27 

2.83 

2.44 

2.01 

1.65 

ARK  1,100) 

1.39 

1.26 

1.13 

1.03 

.87 

.75 

.65 

102(0.01,600) 

1.27 

1.45 

1.72 

1.31 

1.01 

.88 

.83 

MLE(  1,100) 

1.17 

1.25 

1.03 

.86 

.77 

.70 

.61 

002(1,100,3) 

1.19 

1.17 

1.01 

.87 

.76 

.70 

.61 

DM 

HH 

.75 

.67 

.57 

.51 

.43 

.40 

.36 

ARK  0.01, 600) 

1,07 

.95 

.75 

.67 

.61 

.60 

.54 

ARK  1,100) 

1.07 

.94 

.74 

.64 

.55 

.48 

.43 

102(0.01,600) 

.79 

.95 

.81 

.65 

.60 

.59 

.58 

102(1,100) 

.78 

.77 

.67 

.62 

.54 

.51 

.47 

002(1,100,3) 

.75 

.87 

.64 

.58 

.51 

.47 

.45 

SM-16 

RH16 

1.07 

.97 

.80 

.72 

.63 

.58 

.51 

ARK0.01,600) 

1.00 

.84 

.67 

.59 

.50 

.46 

.41 

ARK  1,100) 

1.00 

.84 

.67 

.59 

.50 

.46 

.41 

102(0.01,600) 

1.09 

1.01 

.94 

.92 

.89 

.86 

.84 

ML2(  1,100) 

1.06 

.97 

.87 

.79 

.74 

.68 

.62 

002(1,100,3) 

1.09 

.92 

.74 

.65 

.57 

.52 

.48 

ytmm  - 

lOQp  percentile  cf  the  true  reaper 

ee  curve 

m-c  - 

procedure  (2)  with  constant  c 

AM(6,c)  - 

procedure  (21)  with  lower  and  upper  truncation  bounds  6 

and  c 

*£<«,c)  - 

procedure  ( 10)  with  lower  and  upper  truncation  bounds  6 

and  c 

DU(  «,C,t)  • 

delayed  MLE  prooedse  (24)  with  lower  and  upper  tnnetien  bounds 

6 

end  c,  leg  of  delay  % 
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curve:  ocsplementaxy  log-log  model  (23)  with 


721  (F'tto ,  5) 


starting 

value 


x_  -  I*A 
1  0.6 


x.  -  L„  _ 
1  0.9 


initial 

sequential 

n 

design 

design 

10 

12 

16 

20 

FM-1 

M-1 

.44 

.43 

.40 

.39 

AR<(0.01,600) 

.51 

.50 

.48 

.46 

ARK  1,100) 

.50 

.51 

.51 

.48 

(02(0.01,600) 

.47 

.50 

.45 

.45 

MI£(  1,100) 

.47 

.45 

.45 

.42 

002(1,100,3) 

.48 

.57 

.44 

.43 

RH 

m-4 

.69 

.63 

.55 

.50 

MM(0. 01,600) 

.97 

.88 

.77 

.68 

ARK  1, 100) 

.97 

.88 

.77 

.68 

Ml£(0.01,600) 

.73 

.70 

.65 

.82 

MLE( 1,100) 

.71 

.70 

.63 

.57 

002(1,100,3) 

.74 

.68 

.62 

.57 

JW-16 

M-16 

1.09 

.97 

.82 

.72 

AR!(0.01,600) 

1.09 

.94 

.75 

.61 

ARK  1,100) 

1.09 

.94 

.75 

.61 

MZ2(0.01,600) 

.76 

.71 

.62 

.60 

ML2( 1,100) 

.75 

.69 

.59 

.55 

002(1,100,3) 

.98 

.75 

.60 

.54 

IM-1 

M-1 

.86 

.82 

.76 

.72 

ARK 0.01, 600) 

3.84 

3.41 

2.83 

2.45 

ARK  1,100) 

1.11 

1.03 

.97 

.88 

102(0.01,600) 

.87 

1.03 

1.36 

.91 

102(1,100) 

.81 

.85 

.73 

.67 

002(1,100,3) 

.83 

.89 

.77 

.66 

RH 

R(-4 

.66 

.60 

.53 

.47 

ARKO.01,600) 

.95 

.85 

.75 

.64 

ARK  1,100) 

.95 

.85 

.71 

.62 

ME2(0.01,600) 

.71 

.78 

.74 

.61 

102(1,100) 

.70 

.69 

.63 

.58 

002(1,100,3) 

.73 

.83 

.60 

.54 

m-16 

M-16 

1.04 

.96 

.84 

.73 

AR<(0.01,600) 

1.01 

.89 

.70 

.61 

ARK  1,100) 

1.01 

.89 

.70 

.61 

102(0.01,600) 

.94 

.83 

.75 

.72 

(02(1,100) 

.94 

.83 

.71 

.64 

002(1,100,3) 

1.06 

.86 

.67 

.59 

37 

.35 

.34 

62 

.63 

.57 

45 

.43 

.40 

46 

.42 

.50 

41 

.38 

.36 

39 

.39 

.36 

43 

.39 

.35 

58 

.52 

.47 

58 

.52 

.47 

57 

.55 

.62 

53 

.49 

.45 

48 

.45 

68 

.65 

01 

1.75 

76 

.68 

83 

.66 

58 

.55 

60 

.54 

37 

.34 

48 

.43 

47 

.42 

51 

.48 

47 

.43 

45 

.42 

'frit 
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Lq  g,  the  simulation  result  defies  the  asymptotic  prediction.  In  tact , 
according  to  a  standard  asymptotic  result  on  RM  (Lai  and  Robbins,  1979, 
Theorem  2  (ii)),  the  convergence  rate  of  xn  -  Lq.5  ^or  xn  generated  by 
RM-1  is  of  order  n"0*25  while  both  RM-4  and  RM-16  give  the  better  con¬ 
vergence  rate  n”®*®.  The  reason  that  the  asymptotic  results  are  not 
applicable  here  is  because,  for  x^  close  to  Lq  g,  a  small  c  in  the 
RM  recursion  (2)  is  needed  to  ensure  a  steady  convergence  to  1*0.5*  Even 

a  moderate  value  like  c  =  4  will  make  the  correction 

I  ,412 

n+1  n  n  2  n 

too  fluctuating  for  small  n. 

2)  The  ARK  designs,  despite  the  asymptotic  promise,  do  not  do  as  well  as  the 
RM-designs.  For  the  poor  initial  design  (Lq9,RM-1),  ARM( 0. 0 1, 600 ) 
performs  miserably.  By  choosing  tighter  truncation  bounds,  ARM( 1,100) 
improves  over  ARM( 0.01,600)  and  even  beats  RM-1  in  the  standard  logit 
model.  The  only  other  case  that  gives  the  ARM  an  edge  over  the  RM  is  the 
initial  design  (Lq^^, rm-16)  in  category  (P). 

3)  Three  versions  of  the  MLE  designs  are  under  comparison.  There  is  a  sub¬ 
stantial  improvement  over  MLE ( 0. 01,600)  by  using  MLE( 1,100)  with  tighter 
truncation  bounds.  Additional  improvement  is  made  by  using  the  delayed- 
MLB  design  CMLE( 1, 100,3)  with  lag  3.  When  (and  only  when)  the  initial 
designs  are  in  category  (P),  MLE( 1,100)  and  ENLE( 1, 100, 3)  beat  the  RM 
design.  In  a  few  cases,  MLE (0.0 1,600)  also  beats  the  RM-design.  The 
superior  performance  of  the  RM  designs  in  category  (G)  depends  critically 
on  good  prior  knowledge  of  1*0.5  and  F*  (Lq  g).  When  such  knowledge  is 
not  available,  the  MLE  design,  MLE( 1,100),  does  better.  Of  course  the 
choice  of  the  tighter  bounds  1  and  100  in  MLE( 1,100)  assumes  a  good 
knowledge  of  the  slope  FML0.5)  (but  not  of  1*0.5)*  though  not  in  the 
same  degree  as  the  RM  designs. 
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4)  1)16  conclusions  seem  to  be  independent  of  the  choice  of  distributions. 

The  results  from  (not  reported  here)  the  skewed  logit  model  lead  to  the 
same  conclusions. 


7.  Concluding  remarks 

In  this  paper  a  new  class  of  sequential  designs  for  binary  response  data 
is  proposed.  Its  consistency  and  asymptotic  normality,  via  its  connection 


with  the  Itobbins-Monro  method,  are  demonstrated  under  rather  restrictive 


conditions.  These  methods  are  compared  in  a  simulation  study  for  sample  sizes 
up  to  35.  It  is  somewhat  unexpected  that  their  relative  performance  depends 
quite  heavily  on  the  choice  of  the  initial  designs.  The  fixed  initial  designs 
in  Section  6.1  have  design  levels  spreading  evenly  over  wider  intervals.  The 
levels  of  the  nonadaptive  Itobbins-Monro  designs  in  Section  6.2  tend  to  be 
unevenly  distributed  and  not  so  wide-spread. 

The  empirical  results  suggest  that,  when  a  good  Initial  PM  design  is 
available,  the  PM  design  should  be  used  for  the  first  phase  of  the  experiment. 
For  larger  n,  PM  may  be  replaced  by  AFM  or  MLE  to  take  advantage  of  the 
asymptotic  optimality  of  the  latter  designs.  But  if  the  quality  of  the 
initial  PM  design  is  not  certain,  a  MLE  design  with  tighter  truncation  bounds 
or  its  delayed  version  should  be  used.  It  is  possible  that  other 


& 


modifications  of  the  MLE  design  will  further  enhance  its  utility.  This  merits 


further  study. 


It  is  easy  to  conceive  practical  situations  in  which  other  initial 


designs  are  preferred.  The  experimenter  may  not  have  any  vague  idea  about 


1^  and  F'(Lp),  two  elements  critical  to  the  performance  of  the  PM  design. 


One  common  practice  is  to  choose  a  wide  interval  that  is  believed  to  contain 


the  target  value  1^,  and  to  place  the  initial  design  levels  evenly  over  the 
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interval,  including  the  two  end  points.  It  avoids  the  adverse  effect  of 
extremely  misleading  guesses.  The  business  of  choosing  the  first  five  to 
eight  design  levels  is  a  very  subjective  one.  A  good  experimenter  will 
exercise  his  best  judgement  and  utilize  whatever  prior  knowledge  available  to 
him  in  making  his  choice. 

The  simulation  results  of  Section  6. 1  suggest  that  the  MLE  design  can 
take  full  advantage  of  the  past  information  if  the  initial  design  levels  are 
wide-spread,  and  the  response  region  and  the  nonresponse  region  overlap.  The 
latter  condition  implies  that  (9)  is  satisfied.  Since  the  initial  samples 
that  do  not  satisfy  (9)  are  discarded  in  the  simulation,  our  conclusion  should 
only  apply  to  those  initial  samples  that  are  ready  for  the  application  of  the 
MLE  design.  For  initial  sample  size  10,  the  number  of  discarded  samples  is 
not  negligible  (between  56  and  114  out  of  500,  Table  II).  When  the  initial 
sample  size  is  raised  to  14,  as  in  Table  II (bl),  the  number  drops  from  56  to 
14  while  the  number  of  runs  saved  by  the  latter  design  increases  (Table  III). 
The  percentage  of  discarded  samples  would  be  much  smaller  in  practical 
situations  since  any  sensible  experimenter  should  be  able  to  conduct  the  first 
ten  runs  to  satisfy  condition  (9). 

In  summary,  the  proposed  MLE  designs  are  useful  alternatives  to  the 
standard  ones.  They  perform  well  in  some  selected  situations.  Further  study 
is  needed  to  find  ways  of  improving  their  efficiency  and  to  identify 
situations,  including  the  choice  of  initial  designs,  in  which  they  excel  over 
their  competitors. 
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distribution-free  and  optimal  via  its  connection  with  the  latter  procedure.  For 
certain  choices  of  initial  designs  the  proposed  method  performs  very  well  in  a 
simulation  study  for  sample  sizes  up  to  35.  A  nonpar ametric  sequential  design, 
via  the  Spearman-Klrber  estimator,  for  estimating  the  median  is  also  proposed. 
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